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The current investigations on hyper-heuristics design have sprung up in two different flavours: heuris- 
tics that choose heuristics and heuristics that generate heuristics. In the latter, the goal is to develop a 
problem-domain independent strategy to automatically generate a good performing heuristic for the 
problem at hand. This can be done, for example, by automatically selecting and combining different 
low-level heuristics into a problem specific and effective strategy. Hyper-heuristics raise the level of 
generality on automated problem solving by attempting to select and/or generate tailored heuristics 
for the problem at hand. Some approaches like genetic programming have been proposed for this. In 
this paper, we explore an elegant nature-inspired alternative based on self-assembly construction pro- 
cesses, in which structures emerge out of local interactions between autonomous components. This 
idea arises from previous works in which computational models of self-assembly were subject to 
evolutionary design in order to perform the automatic construction of user-defined structures. Then, 
the aim of this paper is to present a novel methodology for the automated design of heuristics by 
means of self-assembly. 



1 Introduction 

A hyper-heuristic is a search methodology that selects and combines heuristics to generate good solutions 
for a given problem. The design of a hyper-heuristic is important and we believe that adapting natural 
construction models is a suitable approach to consider Cooperative construction processes capable of 
orchestrating adequate building blocks to achieve efficient composites are observed in nature such as 
self-assembly and self-organisation. In particular, self-assembly is a phenomenon in which complex 
structures emerge out of local interactions between autonomous components. The purpose of this paper is 
to propose a nature-inspired cooperative strategy as a method for the automated construction of heuristic 
search strategies. Given a computational search problem and a set of simpler heuristics embodied in self- 
assembly entities, the idea is to develop a novel methodology for the bottom-up manufacture of heuristic 
composites capable of producing high quality solutions. For this to be done, our methodology unfolds 
three main steps: execution threads analysis, assemblies characterisation and evolutionary design. In the 
following, Section |2] gives a brief introduction to hyper-heuristics, self-assembly and the context of our 
investigation. Section [3] enlarges on the proposed approach giving details of the model components and 
the methodology. After that, experiments and initial results are presented and discussed in Section |4l 
Finally, conclusions and further work are the subject of Section [5] 
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2 Self-assembly Design and Hyper-heuristics 

Self-assembly is a natural construction process where aggregates emerge spontaneously throughout the 
progressive interactions among the constituents of the system |[26l . Made upon cooperative self-reliant 
components, self-assembly systems are distributed, not necessarily synchronous, autopoietic mecha- 
nisms for the bottom-up fabrication of supra-structures. Polymerisation, nucleic acid structures and 
crystallisation, to name but a few, are some of the many examples of self-assembly found in nature. 

With the aim to automate the design of a computational model of self-assembly, our previous work 
has focused on the self-assembly Wang tiles model which is formally defined as a quintuple t) 
where ^ is a. finite set of non-empty Wang tiles with square shape, Z is a set of colours which label the 
edges associated to a tile, g is called the glue function that evaluates the strength between any two colours 
of r, ^ is a two-dimensional square lattice with interconnected unit square cells and T is a positive value 
that models the kinetic energy of the system ll27l . Initially, tiles belonging to ^ are randomly located in 
the lattice, the cells of which can be occupied by one tile at any time. Once tiles are placed on the lattice, 
they undergo random walks. When two or more tiles collide, the strength between the colours of each 
pair of colliding edges is evaluated. Subject to this evaluation and the value of the kinetic energy, the 
associated tiles either self-assemble or remain separated. That is, if the resulting strength is bigger than 
T then the tiles stay still for ever forming an aggregate, otherwise they bounce off. In particular, an evo- 
lutionary algorithm, through the process of selection, crossover and mutation, has driven the automated 
design of Wang tiles capable of self-assembling into a user-defined shape. 

Hyper-heuristics are defined as search methodologies that select and combine low-level heuristics to 
solve hard computational search problems fT.'Tl]. The general aim of a hyper-heuristic is to manufacture 
unknown heuristics which are fast, well performing and widely applicable to a range of problems. During 
the process of fabrication, hyper-heuristics receive feedback from the problem domain which indicates 
how good the chosen heuristics are in relation to the problem at hand and, hence, driving the search 
process. Although there are some reported conditions under which free lunches are possible [20], hyper- 
heuristics do not violate the no-free-lunch theorem which indicates that all algorithms that search for 
optimum of a cost function perform exactly the same when averaged over all possible cost functions, 
so no algorithm, including hyper-heuristics, is better than another when considering all optimisation 
problems. Studying novel approaches for the development of hyper-heuristics is important since they 
are domain-independent problem strategies that operate on a space of heuristics, rather than on a space 
of solutions, and rise the level of generality on automated problem solving. Hyper-heuristics have been 
employed for solving search and optimisation problems such as bin-packing |[23l HI, timetabling |[l9l . 
scheduling (TT. TT] and satisfiabihty 13 among others. For detailed reviews of hyper-heuristics and their 
applications, please refer to l22l [T8l[T0i r71. 

The automated manufacture of heuristic search strategies by means of hyper-heuristics has received 
increasing attention in the last ten years or so. Recent investigations have sprung up in two main different 
flavours of hyper-heuristics: 1) heuristics that choose heuristics and 2) heuristics that generate heuris- 
tics. In the first case, a learning mechanism assists the selection of low-level heuristics according to their 
historical performance during the search process. In the second case, the focus is on the search of compo- 
nents that once combined generate a new heuristic suitable for the problem at hand. Approaches based on 
genetic programming have been proposed for the automated generation of heuristics ||9l[T6l|T2l. From an 
engineering point of view, we believe that the manufacture of aggregates resulting from local interactions 
among autonomous cooperative entities is an interesting route for developing a new alternative within 
the second flavour of hyper-heuristics. That is, our interest is on applying self-assembly as a mechanism 
to develop a hyper-heuristic approach to then automatically generate problem-specific good performing 
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heuristics. An early idea of program constructions by means of self-assembly is reported in ifTSll where 
the automated self-assembly programming paradigm (ASAP^) is introduced as a self-assembly model for 
unconventional computing. ASAP^ is defined in terms of gas' molecules embodying portions of software 
sampled from man-made program libraries. Thus, software molecules interact to one another subject to 
different values of temperature and pressure giving rise to a variety of program architectures. The pur- 
pose of the present investigation is to apply previous experiences in evolutionary design of self-assembly 
Wang tiles in order to develop a nature-inspired cooperative strategy for the automatic construction of 
heuristic search strategies. 



3 Proposed Approach 

This section presents our approach for the automated design of heuristics by means of self-assembly. 
In the first part, we introduce the motivation, the components of the model and the general aim of our 
strategy. In the second part, we give a detailed step-by-step description of the methodology together with 
the goals associated to each stage. 

3.1 Model 

Inspired by the physical process of crystallization, Winfree has introduced the Tiles Assembly Model flSl 
as a quadruple {^,ts,g,T) where is a. finite set of non-empty tile types, is a seed tile belonging to 
g is a. strength function and T is a threshold parameter. This model has proven to have computational 
power by simulating a one-dimensional blocked cellular automata. This simulation demonstrates that a 
unique pattern is always produced, regardless of the order in which tiles are aggregated, and that such 
arrangement represents information ultimately modified by tile additions interpreted as rewrite rules. 
Winfree 's model has been employed for solving NP-hard problems BJ |5] IH proving that tile structures 
interpreted as programs are in fact successful. The aim of our model lies in the automatic development of 
problem solving entities. To be more precise, we consider a self-assembly Wang tile as an independent 
low-level heuristic (Figure [TJa)) and an aggregate as a solving strategy in full (Figure (Hb)). 




Solving Strategy 



output Execution Thiread 



(a) (b) 

Figure 1: A self-assembly Wang tile embedding a heuristic with two inputs and an output (a); an aggre- 
gate defining a composition of self-assembly heuristics with two alternative execution threads comprising 
five heuristics each (b). 
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Although there can be sophisticated ways to decide which is the input/output of a tile and how to 
execute the low-level heuristics of an aggregate, we prefer to adopt a simple alternative based on the 
construction of sequences of low-level heuristics. We refer to these sequences as execution threads (Fig- 
ure [Hb)), the construction process of which and the way they operate are given in Section 14.11 Thus, 
given an instance of a combinatorial optimisation problem and a set of low-level heuristics embedded in 
self-assembly Wang tiles, the questions pursued by our research are: 

Is it possible to automatically design an assembly of heuristics, the execution threads of which help 
to find optimal solutions for a given combinatorial optimisation problem? 

If the answer to the above question is yes, is it possible to reuse the methodology in order to tackle a 
different combinatorial optimisation problem? 

In order to address these questions, we propose a methodology divided in three main stages: 1) 
execution thread analysis, 2) assembled heuristic characterisation and 3) evolutionary design. These 
stages are described in more detail in the following subsection. 

3.2 Methodology 

The purpose of the execution thread analysis in stage 1 is to shed light on common combinations of 
heuristics that help to produce high quality solutions when applied to a given problem instance. Hence, 
given a set of execution threads, the research question to address in stage 1 is: 

Is it possible to identify common combinations of heuristics? If yes, how do they look like and how 
reliable is the performance of such combinations when applied to different instances of the problem at 
hand? 

After the analysis and assessment of the execution threads, the best ranked ones are selected and their 
associated assembled heuristics are used as input to stage 2. Then, the goal of the assembled heuristics 
characterisation in stage 2 is to define the target shape that the self-assembly system should attempt to 
generate. Thus, given a set of assembled heuristics the question to address in stage 2 is: 

Which is the morphology characterizing the high quality assembled heuristics? 

The findings reported in ll27l l26l recognise the application of evolutionary algorithms as suitable 
mechanisms for the automated design of Wang tiles capable of self-assembling in a user defined target 
shape. Therefore, given a target shape and a set of low-level heuristics embedded in a self-assembly 
Wang tiles system, the aim of the evolutionary design in stage 3 is to address the following question: 

Is it possible to conduct an automated design of a set of low-level heuristics, the assemblages of which 
return high quality solutions when applied to a given combinatorial optimisation problem instance? 

The above methodology is expected to produce a novel procedure for the automated construction 
of tailored effective and efficient heuristic search strategies. This would also bring additional evidence 
to support the claim that cooperative strategies found in nature are robust mechanisms suitable for the 
development of solutions to combinatorial optimisation problems. 
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4 Experiments and Results 

This section presents the preliminary findings obtained by stage 1 of the above methodology. The chosen 
combinatorial optimisation problem is the widely known Travelling Salesman Problem (TSP) in its sym- 
metric version. As this paper presents a proof of concept, a relatively easy to solve instance is employed 
to illustrate the concept of self-assembly hyper-heuristics. The TSP instance considered here is kroAlOO 
which comprises 100 cities distributed in the Euclidean space. The objective value corresponding to the 
known optimum solution (shortest tour) for this instance is 21282 (see TSPLIbQ). For the experiments 
in this paper, we take the known optimum tour of kroAlOO and apply 200 random swaps in order to 
generate a 'disturbed' tour. In this way, we generated 10 different 'disturbed' tours which are then used 
to evaluate the performance of the execution threads (combinations of heuristics). 



Algorithm 1 ExecutionThreadsAnalysis 
Require: PI a symmetric TSP instance 

1. ETSc ^ collect A'^ execution threads 

2. for all execution threads ETj in ETS^- do 

3. apply {ETi, PI, times) 

4. end for 

5. ETSf^ filter best ETSc 

6. PATTERNS <— analyse common heuristics ETSf 

7. csET build a PAT TERNS -based execution thread 

8. for all execution threads ETi in ETSf U {csET} do 

9. ETSr ^ generate 300 random execution threads 

10. for all execution threads ETj in ETSr do 

11. apply {ETi, PI, times) 

12. apply {ETj, PI, times) 

13. end for 

14. end for 

15. assess ETSf vs. ETSr 



The execution threads analysis stage involves 3 steps: execution threads collection, detection of pat- 
terns of heuristics and performance evaluation. For this, we developed the procedure shown in Algorithm 
[U where lines 1 to 5 define the first step, lines 6 to 7 specify the second step and the remaining lines out- 
line the performance evaluation step. Each of these steps is described in more detail in the following 
subsections. 

4.1 Execution Threads Collection 

In order to generate the execution threads, we employed a percolation cluster model. A percolation model 
is defined as a collection of both empty and occupied sites distributed across a lattice. In this model, the 
non-empty sites of the lattice can be partitioned into clusters such that there is always a path between any 
two sites of the same cluster and non-empty sites of different clusters are disconnected. In particular, we 
employeda2D square site percolation cluster with occupation probability p E {0.05,0.1,0.15, .. . ,0.95}. 
That is, for each site of the cluster a random value v G [0, 1] is obtained. If v < p then the site is filled 
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with a low-level heuristic chosen at random, otherwise it stays empty. Figure |2] shows two percolation 
clusters generated with p = 0.2 and p = 0.5. 




(a) (b) 

Figure 2: Two percolation clusters on a two-dimensional square lattice using p = 0.2 (a) and p = 0.5 
(b). The low-level heuristics are uniformly distributed across the percolation cluster. 

The reason for using percolation clusters is that the geometry (shape) of the resulting aggregates 
is similar to the ones resulting from the self-assembly Wang tiles system. In addition, since there is a 
correlation between the occupation probability p (size of the aggregates) and the length of the possible 
random walks [13], different values of p would allow us to systematically explore different lengths of 
execution threads. Therefore, in order to collect an execution thread, a random walk over the lattice is 
performed. That is, a non-empty site in the lattice is arbitrary selected and from there the nearest one is 
chosen at random. If the selected site hosts a heuristic, the execution thread increments its length and 
the process is repeated by choosing the following nearest site. Otherwise, the execution thread does not 
increment its length and the collection finishes. Note that backward walks and crossings could increment 
the length of the execution thread by adding occurrences of the already collected heuristics. Figure [3] 
shows an example of five execution threads collected from a site percolation cluster with p = 0.5. 




Figure 3: Sample execution threads collected from a percolation cluster. Red sites indicate the initial 
heuristic from where the execution threads start. Green sites are the successive heuristics collected as the 
random walk is performed. 
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For the chosen problem, the low-level heuristics used here are local searches for the TSP that can be 
deterministic (e.g. always selecting the best of a set of improving two-edges interchange) or stochastic 
(e.g. selecting at random from a set of improving two-edges interchange, and hence potentially giving 
different results if re-executed). In particular, 2-Opt, 3-Opt, OR-Opt and Node Insertion are determinis- 
tic whereas 1-city Insertion, 2-exchange, Arbitrary Insertion and Inver-over are stochastic. These eight 
low-level heuristics are originally defined in |[T]|3l [141 l2l] 1211 and can be summarised as follows: 

2- Opt, that eliminates and reconnects those two edges which best minimise the length of the tour. 

3- Opt, that eliminates and reconnects those three edges which best minimise the length of the tour. 

OR-Opt, that eliminates and reinserts a sub-tour of three consecutive cities to the best location, then 
eliminates and reinserts a sub-tour of two consecutive cities to the best location and, finally, eliminates 
and reinserts a sub-tour of one city to the best location. 

Node Insertion, that removes and reinserts the city which best minimises the length of the tour. 

/:-city Insertion, that removes a sub-tour s beginning with a randomly chosen city / through city / + k, 
connects i — I to i + k+ I and reinserts s elsewhere in the tour. In particular, we set ^ = 1. 

?i-exchange, that removes n edges and reinserts n new edges to rebuild a feasible tour. In particular, 
we set n = 2. 

Arbitrary Insertion, that removes a sub-tour S beginning with a randomly chosen city / through a 
randomly chosen city j, connects city / — 1 with city j + 1 and reinserts each city of S in the cheapest 
possible way. 

Inver-over, that removes a sub-tour S beginning with a randomly chosen city / through a randomly 
chosen city j, and reinserts S inverted, i.e. connecting city / — 1 to city j and city / to city 7 + 1. 

In our case, the low-level heuristics described above operate in a hill climber style 1 17 ], i.e. there is 
always an improvement on the TSP where they apply. 

4.2 Detection of Patterns of Heuristics 

For each experiment, we generated 50 percolation clusters with each of the nineteen values of p. From 
each of the resulting clusters, 100 execution threads were collected and applied to the same problem 
instance. In this context, an execution thread application is seen as a pipeline process in which the 
chain of processing elements is given by the sequence of low-level heuristics and the information to 
be processed is the problem instance. Thus, heuristics are applied one after another in the order in 
which they appear in the execution thread and producing better or equal solutions at each step. With the 
purpose to illustrate this process. Figured depicts a very simple example in which an execution thread, 
comprising of 1-city insertion and 2-exchange heuristics, is applied to a TSP instance. Red tile indicates 
the chosen initial heuristic, where the execution thread starts, and the green tiles the successive collected 
ones. Therefore, the application of the execution thread begins by applying the heuristic embedded in 
the red tile and follows by applying the heuristics embedded in the rest of the consecutive green tiles. 
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Figure 4: An execution thread in whicli applications of two 2-exchange heuristics and a 1-city insertion 
heuristic find the optimum solution for the Star of David tour. Edges and cities where the three low-level 
heuristics apply are coloured in red. 

In order to identify common combinations of heuristics within the collected execution threads, we 
grouped the execution threads according to the p that generated their underlying percolation cluster. 
Within each group, the execution threads are then sorted according to the distance between the solution 
that the execution thread produces and the known optimum solution. The top five execution threads 
within each group are then selected and encoded as sequences of characters using 'A' to represent 1- 
city insertion, 'C to represent 2-opt, 'D' to represent 3-opt, 'E' to represent OR-opt, 'T' to represent 
2-exchange, 'F' to represent node insertion, 'G' to represent arbitrary insertion and 'H' to represent 
inver-over. Hence, in order to identify common combinations of heuristics among the filtered execution 
threads, we employ a multiple sequence alignment (MSA) method [24] over the encodings. The results 
reveal that there are indeed occurrences of common combinations, i.e. patterns of heuristics, among the 
best ranked execution threads. Thus, these findings give a positive answer to the first research question 
that we stated for stage 1 of our methodology (Section [l!2l) . Figure |5]highlights in blue the patterns found 
among the best five execution threads collected from percolation clusters using p = 0.9. 

ETl EdED — Ga — G aGacfC AC — 

ET2 G Gddd-G DDhA 

ET3 eThE-E G — CG tG CD C — 

ET4 T DgdG G G DD-A-Td 

ET5 ftfttfa GccCG CT- 

III I II I I I I I I I 
III I II I I I I I I I 
cET T-E-ED — G — CG G CDD-ACT- 

Figure 5: Multiple sequence alignment of the top five execution threads collected from percolation clus- 
ters generated with p = 0.9. Capitals highlighted in blue indicate the common sequences of heuristics. 

An extra execution thread is then constructed in terms of the spotted patterns of heuristics. This pro- 
cedure consists in copying the matching characters between two or more encodings into a new sequence 
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from left to right and following the position in which they appear. For instance, Figure [5] shows that 
cET is the resulting pattern-based execution thread encoded as TEEDGCGGCDDACT, after combining 
the common patterns from the input execution threads ETl to ET5. Given that this execution thread is 
built in terms of common combinations of heuristics, its performance is then expected to be as good as 
(or better than) any of the top ranked. Notice that the length of the constructed execution thread varies 
according to the number of matches. Since this is related to the way in which the construction procedure 
is defined, we left open to further investigations other alternatives to construct the common execution 
thread, e.g. by calculating the optimal common sequence in the alignment. 

4.3 Performance Evaluation 

Since the best five execution threads were evaluated only once, a better way to assess their performance 
is needed. For that reason, we assess the best five execution threads, and the one constructed in terms of 
patterns of heuristics, by conducting a vis-a-vis comparison between their performances and randomly 
generated ones with the hope that, on average, the best tour improvements are obtained by the common- 
sequence execution threads. Thus, for each of the six execution threads, 300 copies are obtained and 
for each of these copies a new execution thread equal in length is randomly created. Since stochastic 
low-level heuristics could be part of an execution thread, a total of 10 independent evaluations are per- 
formed and the average distance between the lengths of the resulting tours and the known optimum was 
considered as the measure of its performance. 

Two representative analyses of the performance evaluation results obtained across the 10 experiments 
are shown in Figure[6](a - b). The boxplots in Figure |6](a) depict the assessment when employing a TSP 
tour with value 165905 whilst the boxplots in Figure [6] (b) correspond to the results for a TSP tour with 
value 191550. In general, we can observe that in both experiments the best five execution threads (ETl, 
ET2, ET3, ET4, ET5) outperform on average the associated randomly generated ones (RNDsl, RNDs2, 
RNDs3, RNDs4, RNDs5). In particular, some of the smallest observations depicted by the boxplots of 
RNDsl and RNDs5 in Figure |6] (a) show that few randomly generated execution threads outperformed 
ETl and ET5 in Figure |6] (a). A similar situation can be observed between RNDs2 in Figure [6] (b) and 
ET2 in Figure [6] (b). This is not surprising since among all the available heuristics, there is still the 
chance that certain arrangements of such were not considered during the execution threads collection 
step. Nevertheless, according to the values of the medians, the amount of missing arrangements found 
among the 300 randomly generated is still not enough to outperform in average a systematically collected 
execution thread. 

Regarding the execution threads constructed in terms of patterns of heuristics (cET), it is clear that 
their performance is better when compared to the associated randomly generated execution threads 
(RNDs6). In addition, it is always the case that the performance of an cET (common-sequence exe- 
cution thread) is as competitive as the performance of the best five input execution threads. Hence, these 
findings indicate that the discovered patterns are in fact beneficial combinations of low-level heuris- 
tics necessary for solving a symmetric TSP instance. All in all, the analyses and results unfolded here 
constitute a positive answer to the second research question stated for the first stage of the presented 
methodology (Section [J!2l) . i.e. the identified common-sequences of heuristics are indeed reliable. 
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T \ 1 \ 1 \ 1 \ 1 \ r 

ET1 RNDs1 ET2 RNDs2 ET3 RNDs3 ET4 RNDs4 ET5 RNDs5 cET RNDs6 



(a) 



! ° 

H i 



a 



ET1 



RNDs1 



ET2 



RNDs2 



ET3 



RNDsS 



(b) 



ET4 



RNDs4 



ET5 



RNDsS 



cET 



RNDs6 



Figure 6: Performance evaluation of two independent experiments. Each boxplot summarises a vis-a- 
vis comparison between the performances of the best ranked execution threads (ETl, ET2, ET3, ET4, 
ET5) and their associated randomly generated (RNDsl, RNDs2, RNDs3, RNDs4, RNDsS) as well as the 
pattern-based execution thread (cET) and its associated randomly generated (RNDs6). 
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5 Conclusions 

In this paper, we proposed a nature-inspired approach for the automated design of heuristics following the 
rationale of hyper-heuristics which are heuristic methods to generate tailored heuristics for the problem 
in hand. Our model considers the use of self-assembly Wang tiles embedding low-level heuristics and 
their assemblages as higher-level heuristic strategies. The proposed methodology consists of 3 stages: 
execution thread analysis, assembled heuristics characterisation and evolutionary design. 

In particular, we reported experiments and results from the execution threads analysis stage involving 
three steps: execution threads collection, detection of patterns of heuristics and performance evaluation. 
On the one hand, the initial findings confirm that there are indeed common patterns of heuristics among 
the top ranked execution threads. This emergent recurrent structures are non-divisible local search strate- 
gies beneficial to achieve good solutions when solving a symmetric TSP instance. On the other hand, 
the assessment of the execution threads produced positive results about the reliability, with respect to the 
performance, of the collected local search strategies. These findings reveal that the top execution threads 
are good performing arrangements of heuristics and that the emergent patterns are beneficial to obtain 
good solutions. 

To continue with our methodology, future work involves the morphological characterisation of the 

common-sequence assembled heuristics and the evolutionary design. The integration of these two stages 
together with the methodology presented here is expected to produce a novel procedure for the automated 
construction of heuristic search strategies. 
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